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I ntroduct ion 


te  field  arithmetic  may  be  efficiently  applied  for 


implementing  signal  processing  architectures.  The  fundamen¬ 
tal  theoretical  work  in  this  area  was  done  by  Matluk  and  Gill' 
r.  They  showed  how  convolutions  over  a  residue  class  ring, 
/modulo  an  integer  M,  the  situation  for  all  implementations 
using  a  finite  digital  representation,  may  be  separated  into 
an  equivalent  system  of  serial  and  parallel  sections.  If  the 
integer  M  has  the  prime  factor  expansion. 


e .  e_ 

M  1  2 

M  =  Pi  /  P2  / 


,  p^  a  distinct  prime, 


each  section  in  this  decomposition  performs  a  convolution 
employing  finite  field  arithmetic.  The  general  decomposi¬ 
tion  is  shown  in  Figure  1.  Furthermore  when  M  contains  no 
primes  raised  to  a  power,  this  decomposition  consists  only  of 
parallel  sections,  each  using  arithmetic  associated  with  a 
distinctive  prime.  Recently  these  techniques  have  been 
expanded  and  fast  algorithms  for  use  with  signal  processing 
systems  have  been  developed  [7]. 

This  report  presents  several  new  approaches  for  incor¬ 
porating  error-correcting  codes  with  signal  processing 
operations  yielding  fault  tolerant  systems.  Fault  tolerant 
levels  can  be  distributed  throughout  the  system's  architec¬ 
ture.  Such  architectures  will  become  necessary  when  very 
sophisticated  and  dense  systems  are  implemented  with  Very  — - 


•-  t  *-  w'- 


CONVOLUTION  OVER 
FINITE  FIELD  GF(p1) 


Figure  1 

Seria I  -  Pa ra 11  el  System  Decomposition  of  Convolution 
Over  a  Residue  Class  Ring  Modulo  M 


Large  Scale  Integration* (VLSI) . 

This  introduction  describes  the  basic  approach  for  in¬ 
cluding  error-correcting  codes  with  the  convolution  operation. 
Several  architectures  are  developed  that  will  protect  against 
permanent  and  temporary  failures  in  the  hardware.  The  theore¬ 
tical  support  for  these  techniques  is  given  in  succeeding 
sections.  Further  details  are  contained  in  Appendices  A-F. 

The  desired  signal  processing  operation  is  equivalent 
to  the  multiplication  of  two  polynomials  a(x)  and  b(x)  where 
a(x)  denotes  the  input  sequence  and  b(x)  corresponds  to  the 
desired  filter  impulse  response.  It  will  be  assumed  that  the 
degree  of  their  product  does  not  exceed  an  integer,  k,  and  that 
the  coefficients  of  the  polynomials  are  from  a  suitably  chosen 
finite  field,  GF (q) .  Furthermore  the  proper  sampling  and 
quantization  of  the  input  and  weighting  sequences  is  considered 
to  have  been  accomplished  in  accordance  with  accepted  practices 
[ 6] .  The  required  convolution  operation  is  stated  in  mathe¬ 
matical  terms  as: 

a(x)  b(x)  ;  degree  [a(x)b(x)]  <  k 

a  (x)  ,  b  (x)  e  GF  (q)  [x] 

Cyclic  codes  are  described  in  terms  of  polynomial  alge¬ 
bras  where  the  code  is  a  special  subspace  called  an  ideal 
[2-5].  All  polynomials  in  the  algebra  are  reduced  in  a 
cyclic  fashion  and  an  ideal  is  generated  by  taking  multiples 
of  a  single  generator  polynomial.  Polynomial  multiplication 


involving  an  element  of  the  code  space  always  produces  another 
element  in  the  code.  Cyclic  codes  with  their  error-protecting 
structure  are  ideal  for  digital  filtering  because  polynomial 
multiplicai tons  are  the  fundamental  operations  in  both  realms. 
Throughout  this  presentation  the  cyclic  code  will  have  length 
n  and  the  integer  k  will  denote  the  number  of  information 
digits  represented  in  each  codeword.  The  polynomial  algebra 
underlying  the  cyclic  code  is  defined  modulo  the  polynomial 
(xn  -  1)  ,  [2-5]  . 

Suppose  that  one  of  the  polynomials  in  the  product  a(x) 
b(x)  is  replaced  by  a  codeword  from  the  cyclic  code  with 
generator  polynomial  g(x).  The  filter  sequence  represented 
by  b(x)  may  be  encoded. 

b  lx)  -*■  [b  (x)  g  (x)  ]  ENCODING  OF 

FILTER  RESPONSE 

When  the  encoded  filter  response  is  multiplied  by  a(x),  a 
codeword  results.  The  desired  filter  result  is  the  informa¬ 
tion  part  of  the  codeword  since  the  degree  of  a(x)  b(x)  is  • 
less  than  k  and  the  degree  of  the  generator  g(x)  is  (n  -k)  . 

a(x)  [b(x)  g(x)]  =  [a(x)  b(x)]  g(x)  CODEWORD 

DESIRED 

FILTER 

RESULT 

The  polynomial  a(x)  represents  the  input  to  the  filter,  but 
since  b(x)  corresponds  to  a  fixed  filter  response  and  g(x)  is 
a  known  encoding  polynomial,  [b(x)  g(x)]  may  be  precomputed 


and  stored. 
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Figure  2  shows  the  system  philosophy  for  employing  the 
code  space.  This  represents  the  general  case  of  a  non- 
systematic  code  since  the  information  digits  are  not  assigned 
to  fixed  positions  in  the  codeword  [5].  The  special  case  of 
systematic  codes  will  be  discussed  shortly.  In  Figure  2, 
two  extra  subsystems  that  provide  the  protection  are  indicated 
One  is  the  Error  Detector/Corrector  which  extracts  the  correct 
desired  product  from  the  output  of  the  polynomial  multiplica¬ 
tion  section  while  the  other  is  an  Error  Status  Check  system 
which  determines  if  errors  have  occurred  and  whether  they  are 
from  the  multiplication  section  or  lie  in  the  Error  Detector/ 
Corrector  itself.  Clearly  it  is  possible  for  two  of  the  three 
subsystems  to  introduce  errors  that  go  undetected.  However 
the  probability  of  this  type  of  error  is  substantially  less 
than  an  unprotected  system. 

Error-correcting  codes  were  designed  for  detecting  and 
correcting  additive  errors.  When  hardware  failures  lead  to 
these  types  of  errors  at  the  system's  output,  the  code  can 
detect  and  may  also  be  used  to  correct  the  errors.  However 
it  will  also  be  shown  that  the  code  can  detect  and  correct 
other  types  of  errors  that  arise  in  hardware  systems. 

Systematic  Form  of  the  Code: 

A  systematic  form  of  the  cyclic  code  may  be  used  in  the 
system  described  above.  In  such  a  form  the  desired  filtering 
opera*  "on's  a1*  put  appears  in  an  unaltered  format  at  the  out- 


.%Vv\V*.V.\V V.V 


Figure  2 

DICHOTOMY  OFSIGNAL  PROCESSING 
SYSTEM  EMPLOYING  CONCURRENT 
ERROR  PROTECTION 


V  • 
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put  of  the  polynomial  multiplication  subsystem.  Thus  no 
further  operations  are  required  to  extract  the  result  if  no 
errors  have  been  made.  However  in  this  case  two  parallel 
similar  subsystems  are  required.  One  subsystem  calculates  the 
direct  filter  output  while  the  other  computes  the  corresponding 
parity-check  digits. 

For  the  systematic  form  the  stored  encoded  filter  weights, 
labeled  b(x)g(x)  in  Figure  2,  are  computed  differently.  The 

n-k 

term  x  b(x)  is  reduced  modulo  gCx)  to  obtain  the  parity- 

check  portion  of  the  codeword  denoted  by  [-p(x)].  The 

n—R 

Euclidean  Division  Algorithm  when  applied  to  x  b(x)  using 
g(x)  as  the  divisor  [5]  gives: 

xn-kb(x)  =  f  (x)  g  (x)  +  p  (x)  ;  deg  p(x)=?deg  g  (x)  =  n-k  (1) 

ri- R 

The  polynomial  [x  b(x)  -  p(x))  is  a  codeword,  and  more 
importantly  the  parity-check  digits  represented  by  [-p(x)]  are 
confined  to  the  lower  ordered  (n-k)  coefficients.  On  the  other 
hand  the  weighting  contained  in  b{x)  appears  in  the  higher 
ordered  k  positions.  Thus  the  codeword  may  be  separated  into 
two  polynomials,  one  representing  the  parity-checks  and  the 
other,  the  desired  weighting. 

[xn_kb(x) ]  +  t-p(x) ]  =  CODEWORD 


FILTER 

WEIGHTING 

PORTION 


PARITY -CHECK 
PART 
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When  multiplied  by  a(x)  the  desired  result  may  be  segre¬ 
gated  into  two  portions  as  shown  in  Figure  3  where  two  similar 
subsystems  are  required.  Only  linearity  is  necessary  to  insure 
this  separation  into  two  parallel  subsystems.  Since  the  degree 
(a(x)b(x)]  is  less  than  k,  the  digits  in  [x  a(x)b(x)]  corre¬ 
spond  to  the  desired  filter  output.  On  the  other  hand  though 
[-a(x)p(x)]  may  have  degree  greater  than  (n-k-1) .  These 
digits  are  only  necessary  when  the  error  detection  and  correc¬ 
tion  systems  are  employed.  The  two  parts  need  only  be  combined 
before  entering  the  error  control  subsystems  as  shown  in  Figure 
3. 

The  systematic  and  nonsys tematic  code  forms  lead  to  similar 
architectures.  In  developing  the  general  system  architecture 
the  nonsystematic  form  will  be  considered.  The  basic  principles 
are  applicable  in  both  situations,  and  only  minor  modifications 
are  necessary  for  the  systematic  case.  The  system  shown  in 
Figure  2  will  be  studied  in  detail  with  particular  attention 
devoted  to  the  subsystem  labeled  polynomial  multiplication. 

Poly n om i al  Multiplication  Using  Component  Polynomials : 

Associated  with  the  code  space  are  irreducible  polynomials 
g^(x),  i  =  1,  2,  ...,  t,  where  the  number  t  is  determined  by 

the  code  space.  These  polynomials  are  factors  of  the  parity- 
check  polynomial,  h(x). 

t 

h (x)  =  n  g ■ (x) 
i  =  l  1 


DIGITAL  WEIGHTING  SYSTEM  USING  A  SYSTEMATIC  CODE 
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bi(x)  =  b  (x)  g(x)  mod  g^x)  (6) 

The  polynomial  multiplication  subsystem  of  Figure  2  may  be 
replaced  by  t  parallel  subsystems  each  involving  component 
multiplications  of  the  respective  factors  a^ (x)  and  b^(x) 
e^(x).  The  t  results  are  recombined  according  to  equation 

(4)  . 

The  terms  b^ (x)  represent  fixed  weights  which  may  be 
stored.  The  theory  shows  that  each  component  multiplication 
a^(x)  b^(x)  is  equivalent  to  a  product  of  corresponding  field 
elements  from  a  finite  field  defined  by  the  irreducible  fac¬ 
tor  g^(x).  The  field  representation  of  this  product  addresses 
shifted  versions  of  the  idempotent  e^(x),  and  a  sum  of  the 
necessary  versions  gives  the  factor  [a^ (x) b^ (x) e^ (x) ] .  This 
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is  shown  in  Figure  4a  where  the  reduction  modulo  g^(x)  is 
an  integral  part  of  the  field  operations.  The  t  products 
each  generated  in  this  way  are  combined  according  to  equation 
(4) .  The  complete  system  appears  in  Figure  4b. 


Use  of  the  Transform  Domain: 


An  alternate  implementation  of  the  polynomial  multipli¬ 
cations  can  be  performed  in  a  transform  domain.  The  mapping 
into  this  domain  involves  a  primitive  n  th  root  of  unity  a 
which  lies  possibly  in  an  extension  field  which  will  be 
denoted  by  GF(qm),  m>l.  However  under  certain  conditions  it 
may  be  possible  to  choose  n  so  that  the  primitive  root,  a 
falls  in  the  base  field  GF (q) .  The  polynomial  multiplications 
of  the  component  polynomials  may  be  transformed  to  an  equiva¬ 
lent  series  of  multiplications  of  the  related  transform 
coefficients.  The  inverse  transform  of  these  results  gives  the 
desired  product.  The  number  of  nonzero  transform  coefficients 
needed  to  implement  the  product  a^(x)y^(x)  is  less  than  the 
degree  of  the  correspondingly  indexed  irreducible  factor  g^(x). 
Furthermore  the  transform  coefficients  may  be  determined  by 
forming  successive  q  th  powers  of  a  single  transform  coeffi¬ 
cient.  The  realization  of  this  device  is  simpler  than  a 
general  multiplier  system  for  the  coefficient  field  GF(qm). 

Figure  5  shows  the  transform  domain  approach  to  polynomial 


multiplication.  The  transform  coefficients  affiliated  with 

/v 

the  component  polynomials  a.(x)  are  labeled  [ a . . ]  while  those 

A 

corresponding  to  the  y^(x)  components,  by  [y^].  The  number 
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IF  £i  =  DEGREE  [g1 ( X) ] .  COMPONENTS 
a i ( X ) ,  bi (X )  BEHAVE  AS  IF  FROM  GF(p£i) 

[a.(X)bi(X)  mod  g  i  { X )  3  ►  FINITE  FIELD  MULTIPLICATION 


STORAGE  OF 
SHIFTED  VERSIONS 
OF  IDEMPOTENT  e i ( X ) 


V 

SYMBOL 


a  i  (  X  ) 


X 

9  i  (  X  ) 

ai(X)bi(X)ei(X) 


b  -  (  X ) 


F i o  u  r  e  4  a 

Multiplication  of  One  Components 


F  i  o  u  r  e  A 

Polynomial  Multiplication  Usino  Components 


'  w 
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ai(X)bi(X)ei(X) 


bf(X) 


f 


Fipure  4b 
Combined  System 


TRANSFORM 

COEFFICIENT 

MULTIPLICATION 


TRANSFORM  DOMAIN  IMPLEMENTATION  OF  POLYNOMIAL  PRODUCT 
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of  nonzero  terms  in  tY^jl  is  guaranteed  to  be  less  than  the 
degree  of  g^(x)  and  so  only  coefficients  in  the  list,  (a^), 
with  similar  indices  need  to  be  determined.  The  locations  of 
the  nonzero  terms  are  known  in  advance  and  are  determined  by 
index  numbers  in  certain  subsets  of  integers,  the  cyclotomic 


subsets  modulo  n. 
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Space  Decompositions 


The  section  describes  the  component  decompositions  of  the 
code  space.  The  general  nature  of  minimal  ideal  expansions  is 
presented  first  followed  by  the  application  of  minimal  ideals - 
to  cyclic  codes.  The  basic  properties  displayed  in  this  sec¬ 
tion  are  also  used  in  certain  aspects  of  the  transform  domain 
implementation.  All  properties  are  stated  without  proofs  but 
the  supporting  developments  are  relagated  to  the  appendices. 


Minimal  Ideal  Decompositions: 

If  the  code  length  n  and  the  size  of  the  ground  field  q 
are  relatively  prime  then  the  polynomial  (xn  -  1)  may  be 
factored  into  distinct  irreducible  factors.  (Say  for  defi¬ 
niteness  that  there  are  T  factors.) 


(x  -  1)  =  II  gi(x)  ;  (n,q)  =  1 

gi (x)  irreducible 

The  ring  of  polynomials  GF  (q)  [x]  ,  reduced  modulo  (x11  -  1)  is 

a  residue  class  ring  in  which  the  minimal  ideals  are  defined 
by  the  irreducible  factors  in  equation  (7) .  The  following 
notational  conventions  are  introduced. 

An  =  GF  (q)  [x]/  ||xn  -  ljj  ;  Residue  Class  Ring  (8) 

Ill’ll  denotes  principal 
ideal  generated  by  f  (x)  . 


m .  ^xj  =  - 1 — r 

i  g^x) 


Mi =  (K(x)l) 


;  MINIMAL  IDEALS  (9) 


i  =  1,  2,  .  .  .  ,  T 


The  fact  that  each  m^(x)  as  defined  in  eguation  (9),  gener¬ 
ates  a  minimal  ideal  is  demonstrated  in  Appendix  A. 

Each  minimal  ideal  also  contains  an  idempotent  e^ (x) 
defined  by  considering  units  modulo  g^ (x)  in  the  minimal 
ideal  M^.  It  also  generates  the  same  principal  ideal.  An 
idempotent  obeys  the  following  identity 


ei(x)  =  e^x) 


IDEMPOTENT 


The  idempotents  and  their  properties  play  a  central  role  in 
the  results  to  follow.  For  example  the  components  necessary 
for  a  direct  sum  expansion  of  any  element  a(x)  e  Ar  can  be 
easily  determined  using  an  orthonormal  property. 


a  (x)  = 


a^x)  ei(x) 


Denotes  a  direct 
sum  expansion 


a^(x)  =  a  (x)  mod  g^(x);  i=l,  2,  ...,  T 


Minimal  Ideals  and  Cyclic  Codes: 


A  cyclic  code  is  a  principal  ideal  in  A^  generated  by 
a  polynomial  g(x).  Furthermore  g(x)  divides  (x11  -  1)  and 
also  defines  the  parity-check  polynomial,  h(x). 

(xn  -  1)  =  g  (x)  h  (x)  (i: 


l8 


Since  (n,q)  =  1,  there  are  no  repeated  factors  in  (x11  -  1)  , 
and  g(x)  and  h(x)  contain  only  distinct  irreducible  factors. 
The  factors  of  h(x)  will  be  indexed  by  i  =  1,  2,  t  and 

those  of  g (x)  by  j  =  t+1,  t+2,  _ _  T. 


t 

h(x)  =  JT  (*) 

i  =  l  1 

(13) 


T 

g(x)  =  JT  g^(x) 
j=t+l  3 


The  degrees  of  these  polynomials  determine  the  permissible 

numbers  of  parity-check  digits  in  each  possible  code  contained 

within  A  . 

n 

degree  g(x)  =  n-k  ;  degree  h(x)  =  k  (14) 

The  code  generated  by  g(x)  will  be  labeled  by  G;  it  is 
a  k-dimensional  subspace  of  An  (and  by  construction  also  a 
principal  ideal) . 

G  =  (  (g  (x)  ) )  (15). 


The  code  space  G  may  be  expressed  in  terms  of  the  t  minimal 
ideals  defined  by  the  respective  factors  g.  (x) ,  i  =  1,  2, 
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It  is  possible  to  define  an  idempotent  generator  for  the 
code  space  G.  If  cascaded  sections  use  the  same  code  space, 
the  idempotent  property  of  this  generator  could  be  used  to 
guarantee  that  no  decoding  would  be  necessary  until  the  final 
section.  This  concept  will  not  be  pursued  further  here,  but 
such  possibilities  for  cascaded  configurations  could  be  use- 


The  Transform  Domain 


Definitions  and  Properties: 


The  degrees  of  the  polynomials  a(x)  and  b(x),  involved 
in  the  weighting  operation,  determine  the  parameter  k  while 
the  desired  level  of  error  protection  determines  the  size 
of  n  for  the  code.  The  choices  of  the  pairs  of  integers 
n  and  k  are  limited  by  the  irreducible  factors  of  txn  -  1)  . 
(See  equations  (7),  (12)  and  (13).)  The  field  GF (q)  may  be 

extended  to  a  larger  field  GF (qm)  and  if  n  divides  (qm  -  1) 
there  will  be  a  primitive  n  th  root  of  unity  in  GF(qm)  .  Le 
o  denote  this  root.  (If  n  is  (q  -  1)  the  root  a  will  lie 
in  the  original  field  GF(q).) 

The  irreducible  polynomials  g^(x)  which  are  factors  of 
(x11  -  1)  are  constructed  using  powers  of  this  root  a  and 
subsets  of  the  integers  modulo  n.  These  cyclotomic  subsets 
index  the  conjugate  roots  in  GF (qm)  of  the  irreducible  fac¬ 
tors.  A  typical  cyclotomic  subset  Ag  consists  of  the  inte- 

2  —1 

gers  modulo  n  of  the  form  {s,  sq,  sq  ,  . ..,  s  q*  }  where 
s  and  ^  are  related  by  the  identity  sq*  =  s  mod  n.  s  is 
generally  taken  as  the  smallest  positive  integer  in  the 


cyclotomic  subset. 


.  i  2  i-l, 

Ag  =  is,  sq,  sq  ,  ...,  sq 1  j 

1 ,  s  defined  by  s  =  sq*  mod  n 


Each  subset  is  constructed  successively  and  inductively 

by  selecting  an  integer,  s,  modulo  n,  that  is  not  contained 

in  a  previously  considered  subset  and  forming  each  integer  s 
■j  £ 

q  until  the  identity  s  =  s  q  mod  n  is  satisfied.  The  inte¬ 
gers  modulo  n  are  partitioned  by  the  cyclotomic  subsets. 

These  subsets  define  irreducible  factors  g^(x). 


g^x)  = 


j  £  As(i) 


(x-a^)  .  (1) 

;  A  some 

s 


cyclotomic -subset 
i  =  1,  2,  .  .  .  ,  T 


The  degree  of  g^(x)  is  defined  by  the  size,  of  the  re¬ 

spective  cyclotomic  subset  A  ^ . 

A  transform  may  be  defined  for  the  space  A^.  It  uses  the 
n  th  root  of  unity,  a,  and  takes  values  in  GF(qm)  as  deter¬ 
mined  by  the  choice  of  this  root.  The  forward  transform 
produces  n  coefficients  in  the  larger  field  GF(qm). 


Yj  =  Y(“J) 


;  j  =  0 ,  1 ,  2 ,  . . . ,  (n-1) 


Ytx)  =  Y0  +  y1  x  +  y2  x2  +  -  +  Yn_x  x"’1  ;  y(x)  e 

The  inverse  transform  has  a  similar  form  and  is  normalized  by 
an  element  in  the  prime  subfield  GF (p)  where  q  =  p  ,  pa  prime 


-  II"'1)) 


n-1  ~  0 . 

I  Y- 
P  j  =0  3 


^  ||n  ^JJ  denotes  the  inverse  of  n  modulo  p.  Note  that  since 
(n,q)  =  (n,p)  =  1  such  an  inverse  element  exists;  there  are 
integers  x  and  y  such  that  xn  +  yp  =  1;  x  =  n  ^  mod  p. 
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The  validity  of  this  transform  pair  is  established  in  Appendix 

C. 


This  transform  pair  has  the  usual  and  important  relation¬ 
ship  between  convolution  in  one  domain  and  pointwise  sequence 
products  in  the  other.  In  symbols  this  relationship  is: 


;  a.  =  a  (a J ) 

3  j  =  0,  1, 

A 

;  y  •  =  Y  (“3) 

3 


. . ,  n-1 


(20) 


CONVOLUTION 


POINTWISE  MULTIPLICATION 


This  relationship  is  also  demonstrated  in  Appendix  C. 
Effects  of  the  Code  in  Transform  Domain: 

The  transform  domain  will  be  used  in  performing  the 
multiplication  of  the  component  factors  a^  (x)  and  b^(x) 
e^ (x)  as  required  in  each  sum  term  of  equation  (4)  .  The 
polynomial  a^(x)  is  defined  in  equation  (5)  while  b^(x)  is 
given  in  equation  (6) .  For  convience  the  stored  components 
will  be  labeled  by  y^Cx). 

Yi(x)  =  bi(x)  ei(x)  ;  i  =  1,  2,  t  (21) 


The  transform  coefficients,  Yjj/  associated  with  each  Y^(x) 
have  an  important  property. 


V  -U 


Y  .  . 


Yi(a^) 


t>i  (a^ ) 


(a- 


bi (a^)  ;  j  e  Ag 
0  ;  j  ^  A  (l) 

(22) 

7  i  —  1/  2 1  .*•/  t 
?  j  —  0/  1/  •  •  •  *  (n-1) 


They  are  nonzero  only  on  the  cyclotomic  subset  A  because 

e^(x),  involves  all  irreducible  factors  except  g^(x).  The 
required  polynomial  product  a^(x)  y^(x)  corresponds  to  a 
pointwise  product  in  the  transform  domain  using  only  those 
transform  coefficients  of  a^(x)  that  have  indices  in  the 
cyclotomic  subset  A  .  They  are  the  only  ones  that  can 
yield  a  nonzero  product. 

On  the  other  hand  the  roots  asq  associated  with  each 

cyclotomic  subset  may  be  viewed  as  an  individual  piece  of 

the  transform  where  the  number  of  elements  in  the  cyclotomic 

subset  A  will  be  denoted  by  The  stored  weights  for 

s  1 

the  i  th  component  y^(x)  are  represented  by  the  nonzero 
transform  coefficients 

~  ( i) 

y •  •  ,  j  e  A  ,i=l,2/...,t. 

1  j  s 

t 

Note  the  total  number  of  nonzero  coefficients  is  £  J. .  =  k. 

i  =  l  1 

The  transform  coefficients  of  the  input  components  a^(x)  need 
to  be  determined  only  for  the  same  set  of  indices.  The  point- 
wise  product  is  formed  and  the  inverse  transform  using  only 
the  roots  defined  by  the  respective  sets  A  yields  the  a^(x) 

y^(x)  products. 


II"  IJ  p 


a^x)  Y^x)  = 


l 

m=0 


l 


i  =  1/  2, 


Recall  that  the  {a^}  coefficients  are  determined  from  the 


input  polynomial  a(x).  The  final  result  [a (x) b (x) g (x) ]  is 
given  by  the  sum  of  these  products  according  to  equation  (4)  . 


The  Transforms  of  the  Polynomial  Components: 

A  property  of  the  transform  pieces  relates  the  zeros 
of  the  polynomial  with  the  location  of  the  zero  transform 
coefficients  and  conversely.  Consider  a  typical  piece  of  the 
transform  of  component  polynomial,  say  c^ (x) ,  over  its  re¬ 
lated  cyclotomic  subset  A  ^ . 

s 


c . 


.  .  =  c.  (a11)  ;  j  e  A 

1  r  J  1 


(i) 


,  i—  1,  2 ,  .  .  . ,  t 


n-1 

=  l  c 


(24) 


r=0 


i/r 


a 


sq  r 


;  j  =  sq 


A  =  0,  . . (ti-l) 


where  c.(x)  =  c.  _  +  c.  .  x+c .  „x  +  ...  +  c.  ,  .  x 

i  i,0  i,l  i,2  i, (n-1) 

The  size  of  cyclotomic  subset  A  is  designated  by 


n-1 


A  useful  result  which  is  a  special  case  of  a  general 
property  for  elements  of  A  is  from  a  Lemma  in  Appendix  D. 


Annihilator  Property 


c.(x)  in  A  has  as  roots  all  a-1  except  for  j  e  A  ' 
in  s 

A 

if  and  only  if  the  transform  coefficients  c..  =  0  for  all 
j  t  A  (i)  . 

w 


In  another  vein,  since  the  polynomials  in  A  have  coeffi 

n 

cients  in  GF(.q).  while  the  transform  nay  take  values  in  GF  (qm) 
there  is  a  constraint  on  the  values  of  the  respective  coeffi¬ 
cients.  This  leads  to  the  Chord  Property  of  the  transform 


coefficients . 


// 
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Chord  Property 


A  A  | 

c^(x)  e  GF  (q)  [x]  if  and  only  if  (c^)q  =  ci|jq|'  3  e  Ag 


This  is  also  a  special  case  of  another  general  result  from 
Appendix  D.  The  Chord  Property  simplifies  the  computation  of 
the  transform  coefficients  affiliated  with  each  polynomial 
component.  The  piece  of  the  transform  indexed  by  the  cyclotomic 


subset  A 


can  be  computed  by  repeatedly  forming  the  q  th 


powers  of  a  single  coefficients.  This  continues  until  all 


exponents  from  A 


have  been  used, 


Calculation  in  the  Transform  Domain: 


The  product  [a(x)  b(x)  g(x)]  can  be  realized  principally 
in  the  transform  domain.  An  inverse  transform  yields  the  final 
result  (See  equation  (23).)  However  as  was  noted  earlier  the 

A  A 

product  of  transform  coefficients  aij'  corresponding  with 

the  polynomial  product  y^(x)  a^(x),  i=l,  2,  ...,  t  are  nonzero 
only  in  nonoverlapping  segments  in  the  transform  domain.  Thus 
it  is  important  to  investigate  the  properties  of  the  inverse 
transform  of  a  sequence  of  transform  coefficients  indexed  by 
a  single  cyclotomic  subset. 

A, 

In  this  regard  let  5(x)  denote  the  sum  below  and  let  Ar 
label  its  transform  coefficients  which  were  produced  by  multi- 

A  A 

plying  the  terms  y^  .  and  a^j  indexed  by  the  cyclotomic  subset 

t  i\ 


6  (x)  =  l  a .  (x)  y  .  (x) 

i=l  1 


A  .=  y  •  •  a  •  • 
D  1J  i-D 


;  j  e  A  111 
s 

l  1  f  2 ,  »  .  «  ,  t 


The  Annihilator  Property  shows  that  the  transform  coefficients, 

A 

A j ,  are  zero  for  indices  in  the  cyclotomic  subsets  related  to 
the  irreducible  polynomial  factors  of  g(x).  The  combined  effect 
on  these  transform  coefficients  may  be  stated  as: 


A.  =  0 


;  j  e  A 


A(g)  =  U  A(j) 

A  j=t+l  s 


The  remainder  of  the  indices  are  contained  in  the  complement 
set,  A  ,  defined  by  the  set  difference  operator  in  the 
following. 

A^"=  £{0,1,2,...,  { n- 1 )}  -  A(g)j  (27) 

The  inverse  transform  determines  the  coefficients  of  6 (x) . 

6.  =  Ifn-1)]  I  T3gT  A  a"jr  ;  j=0,l, 2, . . . , (n-1)  (28) 

D  11  II  P  re  A  r 

Let  Hf  denote  a  generic  root  of  g(x)  .  It  may  be  expressed 
as  a  power  of  a  using  the  appropriate  index  from  A^g^ . 


=  „s<3 


Y  =  a 


1  «  (g) 

;  sq  e  A  ’ 


The  general  result.  Lemma  Dl,  Appendix  D,  shows  that  i|i  is  a 
root  of  6  (x)  ,  and  if  6  (x)  eAn,  the  closure  property  of  the 
individual  cyclotomic  subsets  comprising  the  subset  A^g^  coupled 


28 


with  the  general  chord  property  Lemma  D2  gives  that 

-  q  -  (g) 

A  =  A  for  all  r  e  A  (30) 

r  rq 

Then  g(x)  divides  6 (x)  and  the  error  detector/corrector  subsystem 
will  be  unable  to  distinguish  any  errors  that  were  introduced. in 
«  Cxi . 

A  word  of  caution  is  in  order.  Care  must  be  taken  to  insure 
that  any  hardware  implementation  does  not  satisfy  the  two  condi¬ 
tions  (.26)  and  (30)  ,  thus  preempting  the  error  detecting  capabil¬ 
ity  of  the  code.  For  example  implementing  relationship  (30)  in 

A  A 

the  architecture  to  avoid  computing  all  of  the  products  [y^j  cu  j] 
as  prescribed  in  equation  (25)  could  mask  errors  that  are  intro¬ 
duced  by  hardware  failures.  Fortunately  the  transform  domain 
contains  redundancy  that  protects  against  such  errors. 

Error  Protection  in  The  Transform  Domain: 

If  an  error  occurs  in  the  transform  domain,  numerous  errors 
can  be  introduced  in  the  polynomial  components.  Their  number 
could  exceed  the  error-detecting  or  correcting  capability  of  the 
code.  Two  general  sources  of  errors  in  the  transform  domain 
that  arise  internal  to  the  architecture  are  of  concern.  On  the 
other  hand  any  errors  appearing  momentarily  in  a  stra ightforward 
implementation  of  the  inverse  transform  operation  affect  only  one 
polynomial  coefficient  which  may  be  treated  as  a  normal  additive 
error.  Further  it  can  be  safely  assumed  that  the  stored  trans¬ 
form  coefficients  are  held  in  the  memory  correctly. 
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One  source  of  internal  errors  is  the  calculation  of  the 

A 

transform  coefficients  from  the  input  a(x),  i.e.,  the  a.,  terms 

ID 

may  be  incorrectly  computed.  The  second  form  of  errors  results 
from  the  componentwise  multiplication  in  this  transform  domain. 

A  A 

These  products  {a  y. .}  are  necessary  in  the  inversion  formula 

iD  *0 

(.23)  and  can  propagate  numerous  errors  into  the  An  domain.  It 
is  possible  to  model  both  types  of  errors  by  considering  noise 

A  A 

transform  coefficients  e. .  along  with  the  desired  products  c. .. 

lj 


d .  .  =  c  .  .  +  e  .  . 
a-D  ID  ID 


#  i  1/  2 ,  • •  •  /  t 

j  £  A  (1) 

J  c? 


(31) 


Most  reasonable  hardware  implementations  using  the  trans¬ 
form  domain  will  employ  an  inversion  formula  involving  a  sum 
only  over  the  individual  cyclotomic  subset  as  shown  in  equation 
(23).  Therefore  the  polynomials  resulting  from  the  inversion 
of  the  product  terms  will  obey  the  Annihilator  Property.  Thus 
it  is  reasonable  to  assume  that  the  Annihilator  Property  is 
satisfied.  However  it  is  shown  in  Appendix  E  that  if  the 

A 

noise  transform  coefficients  do  not  obey  the  Chord  Property, 

the  result  of  the  inversion  formula  will  yield  at  least  one 
polynomial  coefficient  with  a  value  strictly  in  the  extension 
field  GF(qm).  Then  of  course  the  polynomial  d^ (x)  obtained  from 

A 

(d^j)  has  at  least  one  coefficient  also  in  GF(q  ),  a  fact  that 
is  easy  to  detect. 

It  is  shown  in  Appendix  E  that  the  error-detecting  capability 
of  this  approach  allows  up  to  (£^  -  1)  transform  coefficients  in 
error  where  the  cyclotomic  subset  has  indices. 


Error 
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detection  is  easily  implemented  by  checking  that  the  inversion 
formula  (23)  only  produces  elements  in  GF(q).  There  is  an 
error-correcting  technique  also  available.  It  is  outlined  and 
discussed  in  Appendix  E.  The  sequence  of  transform  coefficients 

A 

d„  is  compared  with  different  test  sequences.  Each  test 

i  U  A 

sequence  is  generated  by  forming  all  q ■ — -  powers  of  each  d^ 
element.  If  a  coefficient  obeys  the  Chord  Property  then  it  is 
correct;  otherwise  it  can  be  replaced  using  the  Chord  Property 
and  known  correct  elements  in  the  {d^}  sequence.  This  scheme 
will  correct  up  to  i.^-1  errors  in  the  transform  coefficients. 


It  also  can  correct  errors  introduced  by  the  implementation  of 
the  scheme  itself. 

The  error-protecting  levels  in  the  transform  domain  are 

directly  related  to  the  size  % .  of  each  cyclotomic  subset  A^. 

i  s 

Thus  the  choice  of  error-correcting  codes  for  digital  filtering 
applications  should  have  components  with  large  cyclotomic  sub¬ 
sets  (or  equivalently  large  degrees  of  the  affiliated  irreducible 
polynomials).  However  the  overall  efficiency  of  the  space' 
decompositions  depends  on  having  numerous  but  small  component 
factors.  The  classic  trade-off  between  complexity  and  error- 
protecting  capability  is  encountered. 


Imbedding  Error  Protection  in  Fast 
Transform  Implementation 

The  classical  method  of  using  the  transform  domain  employ 
fast  transform  algorithms  for  producing  the  frequency  domain 
coefficients  which  in  turn  are  producted  with  the  stored 
weighting  coefficients,  this  result  being  inverted  by  another 
fast  algorithm  [6].  This  traditional  approach  is  depicted 
in  Figure  6.  However  the  transform  coefficients  in  this 
situation  are  not  sorted  according  to  their  minimal  ideal 
index  as  shown  in  Figure  5.  The  fast  transform  method  has  a 
speed  advantage  especially  when  pipelining  is  incorporated  in 
the  realization.  A  major  disadvantage  is  the  potential  for 
internally  generated  errors  to  propagate  extensively  through¬ 
out  the  implementation.  In  fast  transform  algorithms  each 
intermediate  variable  at  one  stage  is  used  in  several  inter¬ 
mediate  variables  at  the  succeeding  stage.  Thus  even  single 
errors  can  contaminate  many  final  output  values. 

The  purposes  of  this  section  are  to  develop  fast  forward 
and  inverse  transforms,  analyze  the  propagation  and  penetra¬ 
tion  of  internally  generated  errors  and  demonstrate  methods 
and  restrictions  which  insure  safe  operation  of  the  overall 
system  shown  in  Figure  6.  The  techniques  described  below 
will  concentrate  on  containing  and  controlling  the  effects 
of  single  isolated  internal  errors,  primarily  through  error 
detection  followed  by  re-execution  of  the  defective  step. 


It  will  be  clear  that  other  procedures  are  possible  also  and 
that  the  detection  and  correction  of  multiple  errors  are 
easily  implemented  with  more  powerful  codes  and  additional 
restrictions . 

The  finite  field  forward  transforms  is  used  to  obtain  the 

A 

transform  coefficients  a  ^ ,  j  =  o,  1,  .  ..,  (n-1)  from  the  poly¬ 

nomial  a  (x)  . 


a  . 
D 


n-1 

I  ai  a 

•  _ rv 


ID 


i=0 


;  j  =  Q/  1/  • 

r 

q  =  p 

m 


(n-1) 


n |  (q  -1).;  (n,q)  =  1 

th  .  c  .  . 
a  n —  root  of  unity 


(32) 


a (x)  =  aQ  +  a1x  + 


...  +  a  i  x 

n-1 


n-1 


A  prime  factor  fast  transform  algorithm  may  be  developed 
starting  with  the  prime  decomposition  of  the  integer  n. 
Repeated  occurrences  of  the  same  prime  are  permitted. 

M 

n  =  II  p.  ;  p.  =  PRIME  (33) 

i=l  1  • 

Since  n  and  q  are  relatively  prime,  p  cannot  appear  in  the 
product  (33) .  There  are  two  forms  of  the  fast  algorithm 
depending  on  the  initial  decomposition  of  the  indices  i  and 
j  appearing  in  (32):  decimation  in  frequency  and  decimation 
in  time.  Figure  7  shows  the  general  form  of  the  fast  algorithm 
for  the  case  of  n  having  four  factors.  Both  forms  never  use 


INTERMEDIATE  VARIABLES 


more  than  n  intermediate  variables  at  any  stage  of  the 

algorithm.  The  straightforward  mathematical  implementation 

2 

of  formula  (32)  requires  on  the  order  of  n  multiplications 
and  a  similar  order  of  additions.  Either  form  of  the  fast 
algorithm  needs  on  the  order  of 

M 

n  C  l  Pi) 

i=l  1 

such  operations.  This  is  one  source  of  the  speed  advantage 
of  fast  algorithms. 

The  details  of  the  fast  algorithms  are  developed  in 
Appendix  F,  but  a  list  of  the  intermediate  variables  and  the 
ranges  of  the  indices  are  displayed  above  the  interstage  gaps 
in  Figure  7.  Figure  8  gives  the  sets  of  variables  and  their 
interrelationship  for  both  forms  of  the  algorithm.  Pieces 
of  the  appropriate  signal  graphs  are  given  in  Appendix  F 
where  it  becomes  clear  that  an  error  in  one  operation  rapidly 
spreads  to  many  subsequent  intermediate  variables.  However 
in  both  forms  the  intermediate  variables,  the  Y  and  Z  sub- 
scripced  variables,  obey  properties  which  allow  chords  to  be 
used  at  each  stage.  These  properties  may  be  listed  where  the 
ranges  of  the  indices  are  given  in  Figure  8. 
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;  qj^  mod 


Y 

q: 


;  qj2  mod  n 2 


(35) 


The  procedures,  outlined  in  the  previous  section  on 
error  protection  through  chords  in  the  transform  domain,  can 
be  used  for  detection  and  correction  as  detailed  in  Appendix 
E.  Note  from  equations  (34)  and  (35)  that  the  chord  lengths 
are  now  determined  modulo  integers  which  are  divisors  of  n. 
Therefore  it  is  important  to  insure  chord  lengths  greater  than 
one  so  that  detection  is  at  least  possible.  Two  principles 
which  are  demonstrated  in  Appendix  F  may  be  used  in  this 
regard.  One  concerns  the  combination  of  chord  lengths  while 
the  other  is  constraints  on  the  code  length  n. 

The  first  principle  applies  to  the  overall  chord  length 
when  more  than  one  index  and  prime  number  is  involved  as  in 
equations  (34)  .  For  example,  say  that  the  chords  corresponding 
to  index  j ^  mod  p^  is  while  the  one  for  index  j2  mod  p2  is 

V 

*1  _ 

jx  q  -  j±  ™od  Px  .  least 

%2  (36) 

j  2  q  =  j2  mod  p2  ;  £>2  least 


.1 


J 


Then  the  overall  chord  length  applicable  to  Z.  .  ,  for  i 

*1  ,  /  r  1 

J1  J2  x3 

fixed,  is  the  least  common  multiple  of  l,  and 

L12  =  fc.c.m.  U1#Jl2)  (37) 

This  means  by  successively  forming  q—  powers  of  Z .  •  ,  •  , 

3l'  J2  r3 

its  value  is  repeated  first  on  the  L^2  s^t  power. 

The  second  principle  concerns  sufficient  conditions 
insuring  that  all  chord  lengths  for  nonzero  indices  exceed 
length  £.  The  conditions  are 

|  n,  (qS-l)J  =  1  for  all  s  £  i .  (38) 

They  guarantee  that  all  chord  lengths  t  which  satisfy 

j  =  j  mod  p.  i  =  1,  2,  M  (39) 

obey  the  inequality 

l  <  t.  (40) 

With  this  principle  it  is  possible  to  know  when  chord  lengths 
are  favorable  to  detection  or  correction.  The  sufficient  con¬ 
ditions  can  only  be  satisifed  up  to  the  integer  m  because 
n|  (qm-l)  ,  equation  (32)  . 

Even  when  the  restriction  (38)  are  used  to  guarantee 
error  detection  or  correction  through  the  chord  properties, 
there  are  situations  where  errors  can  still  propagate  from  one 
stage  to  another.  The  properties  (34)  and  (35)  show  that  any 
intermediate  variables  with  all  j  indices  equal  to  zero  must 
lie  in  GF (q) ,  e  .g  . , 
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V  0 '  i3  E  GF{qh  ;  °— i3<n3 


Y0'  i  i  e  GF^  •  i2<p2'  i'l<pl 
At  each  stage  there  are  fewer  such  terms  with  the  DC  term, 

A 

a^,  being  the  only  one  in  the  transform  domain  belonging  to 
GF(q).  Furthermore  intermediate  variables  with  zero  j  sub¬ 
scripts  may  propagate  unchecked  errors  only  to  those  new 
variables  at  the  next  stage  which  have  analogous  j  indices 
also  equal  to  zero.  Thus  uncovered  errors  will  only  reach 

/s 

the  DC  coefficeint,  a^ .  However  this  one  term  may  be  pro¬ 
tested  by  redundant  duplication  methods. 

The  fast  inverse  transform  is  developed  in  an  ana¬ 
logous  manner.  It  will  have  the  usual  symmetry  with  respect 
to  the  fast  forward  transform  [6].  Figure  9  contains  the 
general  structure  of  both  the  time  and  frequqncy  decimation 
forms.  The  intermediate  variables  passed  between  stages  are 
shown  also.  These  variables  have  properties  similar  to  those 
in  equations  (34)  and  (35)  with  Appendix  F  containing  the 
formal  development  of  the  algorithm  and  the  properties.  They 
are  shown  below. . 
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Properties  (41)  and  (42)  may  be  used  to  establish  chords 
affording  error  detection  and  correction  as  outlined  earlier. 
The  sufficient  conditions  (38)  clearly  insure  that  all  chords 
associated  with  nonzero  indices  have  at  least  length  Z .  But 
any  intermediate  variables  whose  j  indices  are  all  zero  lie 
in  base  field  GF(q),  and  may  impact  other  subsequent  GF(q) 
variables.  Hence  it  is  possible  to  propagate  errors  from 
one  stage  forward.  In  addition,  an  examination  of  the  appro¬ 
priate  signal  flow  graphs  shows  that  each  such  variable 
affects  numerous  GF(q)  variables  in  the  next  stage.  These' 
errors  penetrate  to  the  final  stage  possibly  affecting  many 
output  coefficients. 

As  an  example  of  this  internal  error  propagation  error 
polynomials,  generically  labeled  e(x),  which  are  added  to  the 
final  result  6 (x)  are  consider.  They  are  developed  for  the 
situations  where  a  single  additive  error,  with  value  e, 
occurs  within  a  stage.  Table  1  summarizes  the  results  of 
these  analyses.  These  error  polynomials  have  the  same  value 
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e  added  to  many  positions  in  the  desired  output  6 (x) .  Never¬ 
theless  it  is  possible  to  detect  such  errors  in  the  final 
output  if  the  code  generator  polynomial,  g(x),  is  probably 
chosen.  It  must  not  divide  the  special  forms  of  e(x)  as 
shown  in  Table  1.  Note  that  each  error  polynomial  is  formed  ' 
by  effectively  removing  certain  n—  roots  of  unity  from  the 
factor  Cxn-1)  .  Hence  if  g(x)  contains  at  least  some  of  the 
roots  which  are  removed  it  could  not  divide  any  of  the  e(x) 
terms  thus  providing  an  error  detection  capability. 

For  example,  in  the  decimation  in  frequency  form  an  error 
polynomial 


e  (x) 


(xn-l)  ‘ 
n3 

(x  -1)J 


can  appear  at  the  output.  But  if  g(x)  contains  as  one  of 
its  roots  an  n^  root  of  unity  (and  of  course  its  conjugate 
roots) ,  all  errors  of  this  form  are  detectable.  Therefore 
proper  code  selection  is  critical  for  protecting  against 

n ; 

internal  errors  in  the  fast  inverse  system.  Since  all  (x  1-1) 
factors  are  divisible  by  (x-1) ,  so  if  g (x)  contains  1  as  a 
root,  every  possible  single  error  failure  may  be  detected. 
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Error  Detection/Correction  and  Error  Status 


The  approach  to  error  control  presented  in  this  chap¬ 
ter  has  intrinsic  opportunities  for  distributed  error  detec¬ 
tion  and  correction  throughout  the  architecture.  Not  all 
possibilities  will  be  explored  here  but  an  obvious  and 
important  aspect  of  error  protection  involves  the  minimal 
ideals.  Each  minimal  ideal,  M^,  which  contains  the  component 
polynomials  is  a  cyclic  code  in  its  own  right  [4],  The 
number  of  parity-check  positions  is  equal  to  the  degree  of 
the  related  irreducible  factor  of  (x11  -  1),  g^(x).  Cyclic 
codes  have  powerful  burst  error-protecting  capabilties  pro¬ 
portional  to  the  number  of  parity-check  positions.  Thus 
error  detection  or  correction  can  be  performed  on  the 
individual  components  [a^ <x) b^ (x) e^ (x) ]  before  the  final 
combination  as  required  by  equation  (4)  is  completed.  This 
protects  against  errors  introduced  in  the  last  stages  of  the 
component  polynomial  manipulations.  This  technique  allows, 
errasure  decoding  to  be  mixed  with  the  usual  decoding  methods 
[2,  5]  .  The  overall  detecting  and  correcting  performance 
levels  increase  accordingly. 

Suppose  that  the  output  of  the  filter  mechanization  of 
a(x)  b(x)  g(x)  can  be  modeled  as  containing  additive  errors. 
The  output  of  the  filter  section  is  given  by  r(x). 


r(x)  =  Ia(x)  b(x)  g (x) ]  +  v(x)  ;  v(x)  error  components  (43) 


V 


Standard  error-control  techniques  [2-5]  may  be  applied  under 
these  conditions.  For  example  the  same  transform  domain  used 
in  the  filter's  implementation  is  also  applicable.  In  this 
situation  the  roots  of  g(x)  as  indexed  by  the  set  A ^ , 
equation  (26),  are  involved.  They  define  the  syndromes. 
(Recall  g(x)  has  degree  (n-k)  and  A has  (n-k)  elements.) 

A  typically  syndrome  is  sft  where 


3. 


sR  =  r(aH) 
p  ft 

=  v(ap) 


;  3  eA 


(g) 


(44) 


Of  course  there  is  the  problem  that  the  Error  Detector/ 
Corrector  system  shown  in  figure  2  could  suffer  errors  similar 
to  the  section  that  it  was  designed  to  protect.  The  Error 
Status  device  is  designed  to  signal  the  occurance  of  such  a 
problem.  Say  that  the  decoder  produces  a  polynomial,  f (x) , 
which  represents  the  desired  product  a (x)  b(x).  An  error 
status  may  be  made  by  encoding  f (x)  through  multiplication  by 
g(x)  and  subtracting  it  from  a  copy  of  r (x) ,  equation  (43). 


p  (x)  =  r  (x)  -  f  (x)  g  (x) 


The  weight  of  the  status  polynomial  p (x)  determines  whether 
the  decoded  element  f (x)  is  the  closest  choice  to  r(x).  This 
gives  a  check  on  the  Error  Detector /Corrector  and  the  Status 


Check  circuit. 


The  Special  Case  of  Systematic  Codes 


All  of  the  previous  discussions  are  applicable  to  the 
case  of  systematic  codes.  As  was  mentioned  in  the  intro¬ 
duction,  the  parity-check  portion,  [-p(x)  a(x)],  when  added 
to  a  shifted  version  of  the  desired  result,  a(x)  b(x), 
yields  a  codeword.  Therefore  the  techniques  described  for 
nonsystema tic  codes  can  be  employed  for  the  parity-check 
portion  of  the  codeword;  only  the  components  from  the  t 
minimal  ideals  that  define  the  code  G  need  to  be  computed. 
Linearity  guarantees  that  no  other  components  are  required. 

The  desired  result  a (x)  b{x)  has  degree  less  than  k 
and  thus  can  be  computed  in  a  residue  class  ring  modulo 

V 

(x  -  1)  which  has  been  labeled  as  A^  in  this  report.  All 
the  minimals  ideals  in  the  algebra  A^  are  employed  now 
because  no  code  is  involved.  However  the  use  of  the  mini¬ 
mal  ideal  decomposition  and  the  transform  techniques  can  be 
advantageously  applied.  One  may  think  of  using  a  rate-one, 
(k,k)  code  in  this  case.  Nevertheless  there  are  intrinsic 
error  detection  and  correction  opportunities  even  in  the  no 
coding  ideals  and  because  of  the  properties  of  the  transform 


domain. 
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A  minimal  ideal  only  contains  itself  and  the  trivial 

ideal  JjoJJ.  The  fact  that  the  ideals  defined  by  itk(x), 

equations  (9) ,  are  minimal  in  the  space  An  will  be  proved 

first;  the  concepts  used  in  this  proof  will  appear  in 

developing  other  properties. 

Suppose  that  there  is  a  smaller  ideal  contained 

within  M^.  Then  there  is  a  polynomial  s^(x)  that  generates 

S.,  i.e.,  S,  =  ((=,<*>)]  .  Since  s^(x)eM^  it  follows  by  the 

definition  of  itk(x)  that  all  irreducible  factors  except  g^(x) 

divide  s.(x).  (For  if  g.(x)  were  also  a  factor  of  s . (x)  then 
i  x  1 

s^(xl=0  in  An-)  Thus  s^(x)  may  be  written  in  the  form 

n  (xl 

s.  Cxi  =  f  (x)_  n  g.JV  4  ;  X,>0  (A-l) 

j=l 

where  f(x)  contains  all  other  irreducible  factors  of  s^(x)  not 
contained  in  the  factorization  of  (xn-l) .  But  then  f (x)  is 
relatively  prime  to  (xn-l) ,  indicating  that  f (x)  is  a  unit  in 
An-  |(f(x),  xn-l) =1  implies  that  there  are  items  y(x)  and 
z(x)  such  that  y(x)f(x)  +  z  (x)  (xn-l)  =1;  y(x)  is  the  inverse 
of  f (x)  in  A  ) .  Hence  it  is  possible  to  take 


A- 2 


Clearly  ((s^x)])^  ((m^^  ( x  >))  •  To  show  the  opposite  inclusion 

it  will  be  demonstrated  that  s^(x)  divides  itk  (x)  .  Since  g^(x) 

is  excluded  from  s^(x),  they  are  relatively  prime.  Then  so  is 

g.{x)  and  the  term,  II  g-^/^w  which  has  all  irreducible  fac- 

j^i  3  X 

tors  of  s^(x)  with  single  power  X.'s  removed. 


(  9  •  (x)  ,  n  g  .  Uj  1}  Cx) )  =  1 
11  3  1 


(A-3) 


Thus  these  are  polynomials  a(xl  and  b(x)  for  which  it  is 
possible  to  write 


(X .-1) 

a(x)  II  g.  -1  (x)  +  b(x)  g.(x)  =  1  (A-4) 


(X.-l)  . 

Then  gi  (x)  divides  ^l-a(x)  II  g^  J  (x)  J  and  it  follows  from 

^  ^  n 

the  definition  of  the  irreducible  factors  of  (x  -1)  that 


n 

(xk  -1’ 

n  g . (x)  fl-a(x) 

j/i  3  1 

j=l 

11  gk 
k^i  K 

(x) 1=  0  mod  (xn-l) 

(A-  5) 

Equivalently  in  An, 

nu (x)  = 

a  (x) 

n  X 

n  g  ■  j  (x) 

3 

j=l 

(A-6) 

The  generating  polynomials  of  the  minimal  ideals  have  an 
interesting  property  in  An: 

nu  (x)  m j (x)  =  0  ;  i/j,  i,j,  =  1,  2,  ...,  T  (A-7) 


A-3 


It  is  easy  to  show  from  this  that  the  T  minimal  ideals  form 
a  direct  sum  decomposition  of  An»  Thus  any  a(x)  e  A^  can  be 
expanded  uniquely  as  a  sum  of  elements  each  possibly  from  one 
of  the  minimal  ideals: 


a(x)  = 


J. 

I  a  . (x)  m . (x) 
3  3 


(A- 8) 


Each  nonzero  term  [a^  (x)  itu  (x)  ]  represents  the  component  of 
a(x)  in  minimal  ideal  M  ^  . 

The  orthogonality  of  the  ideal  generates  m^ (x)  and  m^ (x) 
clearly  demonstrates  that  any  distinct  ideals  share  only  the 
zero  element.  Thus  to  show  that  the  minimal  ideals  M.  can  be 

i 

used  for  a  direct  sura  decomposition  of  An,  it  remains  to  prove 
that  any  element  in  An  can  be  written  using  components  from 
some  of  the  ideals.  The  set  of  polynomials  nu(.x),  i  =  1,  2, 

.  ..,  T  have  their  greatest  common  divisor  as  unity.  Then  there 
are  polynomials  v^(x)  such  that 


1  =  7  v  .  (x)  m  . 

j=i  3  3 


(A-9) 


Multiplying  both  sides  by  any  a(x)  e  Afi  gives: 


(x)  =  l  [  a  (x)  v  .  (x)  m  .  (x)  ] 

i  =  l  3  3 


(A-10) 


Since  none  of  the  nonzero  terms,  [a(x)  (x)  m^ Cx) ] ,  can  be 

in  more  than  one  ideal,  the  direct  sum  expansion  in  equation 
(A— 8 )  is  established  where  a^ (x)  =  a(x)Vj(x). 


.  A- 4 


The  idempotents  have  several  important  properties  which 
will  be  listed  and  then  proved. 


ei(x)  a  (x)  =  a  (x)  ;  aCxJeM.^ 

UNIT  ON 


(A-ll) 


e^  Cx) 


1  j  =  i 

mod  g .  (x) 

0  j  7*  1  1 

ORTHONORMAL 

IDENTITY 


(A-12) 


IDEAL  GENERATOR  (A-13) 


RELATIVELY  PRIME 
RELATIONSHIP 


Each  minimal  ideal  Mi  contains  an  idempotent  that  also 
generates  the  same  principal  ideal.  The  idempotent  is 
determined  by  noting  that  nu(xl  and  g^(x).  are  relatively  prime* 
Hence  there  are  two  polynomials  s^Cxl  and  r^(x).  for  which  the 
following  is  true. 

1  =  s . ( x)  m. (x)  +  r .  Cx)  g. (xl  ;  i=l,  2,  ....  T 

i  l  11 

The  desired  idempotent  e^ (x)  is  defined  by 
e^(x)  =  s^(x)  m^(x>  ;  i  =  1,  2,  ...,  T 


CA-16) 


rtf 


,  A-5 


We  now  detail  the  proofs  of  the  properties  listed  above. 
Firstly  the  basic  idempotent  property  equation  (10)  follows 
by  multiplying  identity  (A-15)  by  e^(x). 


e^x)  =  (x)  +  si(x)  nutx)  r^x)  gi(x) 


( A-17 ) 


=  e^Cx)  +  0 


mod  (x  -1). 


The  property  of  a  unit  also  is  demonstrated  by  choosing  any 
a  Cxi  in  and  multiplying  equation  (A-15)  by  it.  However, 
since  a(x)  =  a^(x)m^(x)  because  it  is  in  the  principal  ideal 
generated  by  iik(x),  a  simplification  is  possible. 


a  (x)  =  a  (x)  e^  (x)  +  ai(.x)  itK(x)  ri(x)  gi(x) 


(A-18) 


=  a  (x)  e^x)  +  0 


modulo  (x  -1) 


Reducing  both  sides  of  identity  CA-15)  modulo  g^ (x)  gives 
the  top  part  of  equation  (A-12)  while  definition  (A-16)  clearly 
shows  that  e^(x)  contains  all  other  irreducible  factors  and  the 
remaining  part  of  the  orthonormal  property  is  demonstrated.’ 

We  observe  that  by  the  definition  of  e^(x),  equation  (A-15), 


(h<x)D  c:  (K(x>|) 


While  on  the  other  hand  combining  identities  (A-15)  and  (A-16) 
and  multiplying  by  itk  (x)  yields: 


nK(x)  =  mi(x)  ei(x)  +  nu  (x)  ri(x)  g^x) 
=  m^(x)  e^Cx)  +  0  modulo  (xn-l) 


(A- 19 ) 


and  therefore 


Hence  itk{x)  is  contained  in  ||e^(x)JJ 

l(mi<x>)l  cr  (K<x)ll- 

Both  m^Cx)  and  e^(x).  are  legitimate  generators  for  as 
shown  in  equation  (A-13) . 

Finally  the  relatively  prime  property  in  equation  (A-14) 

can  be  shown  by  assuming  that  g . tx)  divides  e.(x).  Since  e.(x) 

1  1  1 

is  a  unit,  property  (A-ll) ,  the  following  is  true. 

e.(x)m.(x)  =  itk(x)  (A-20) 


But  by  the  definition  of  m^(x),  equation  (9),  the  left  side 

is  zero  in  A  ,  a  contradiction  to  fact  that  m. (x)  has  degree 
n  l 

strictly  less  than  n. 

Another  interesting  and  useful  property  of  the  minimal 
ideals  is  their  relationship  with  the  appropriately  sized 
finite  fields.  Consider  the  following  mapping  from  1YL  into 
the  cosets  of  the  principal  ideal  (KH)  • 


:  Mi - ►GF  ( q )  [ x ]  /  || g ^  (x )  j 


a  (x)  e^x)  | - ►-a(x)  mod  g^x). 


(A-21) 


FIELD  ISOMORPHISM 


The  range  space  is  known  to  be  a  finite  since  g^(x)  is  irre¬ 
ducible.  Note  that  in  M^  we  may  always  write  each  element 
b(x)  as  a(x)  e.(x)  where  degree  a(x)  <  degree  g. (x) .  Also 


note  that  in  the  minimal  ideal,  e^ (x) ,  acts  as  the  field 
identity,  but  it  is  not  the  identity  of  the  ring  An» 

To  establish  the  isomorphism  (A-21)  we  first  show  that 
every  b(x)  is  equivalent  to  another  polynomial  a(x)  with 
degree  less  than  degree  g^(x).  The  Eucledian  algorithm  can 
be  used  to  show  that 


b (x)  =  aiCx)  gi(x)  +  a(x) 


( A—  2  2 ) 


where  deg  a(x)  <  deg  g^(x) 


It  then  follows  that  because  of  the  unit  property  of  e^(x). 


b (x)  =  b (x)  e^x) 


(A-23) 


=  (x)  g^(x)  (x).  +  a(x)  e^x)  =  a(x)  e^(.x) 


Consider  any  a(x)  e  GF(ql[x]/  ||g(x)JJ  .  The  element  a(x)  e^x) 
in  clearly  is  mapped  to  it  by  F^.  Since  the  number  of 
distinct  elements  in  each  space  is  equal  the  mapping  is 


one-to-one  and  onto.  The  mapping  F^  preserves  both  sums  and 


products.  Note  since  |g^(x),  e^(.x)  J  =  1  the  item  a^fx)  e^(x) 
bi(x)  eilx)  =  a1(x)  b^Cx)  e^(x)  maps  into  a^ (x)  b^(x)  mod  gi(x) 
The  mapping  (A-21)  gives  mod  g^(x)  all  of  the  properties  of 
a  field  and  also  explains  why  e^(x)  acts  as  a  unit  on  the 
space  M.  mod  g. (x) . 


Appendix  B 


Idempotent  Expansion  of  the  Code  Ideal 


The  direct  sum  decomposition  of  G,  equation  (16) ,  may 
be  demonstrated  in  the  following  manner.  Since  g(x)  e  A^ 
it  may  be  expressed  using  the  minimal  ideal  expansion  as 
per  equation  (11) . 


g  (x)  =  ffl  y  .  (x)  e.  (x) 


y^x)  =  g  (x)  mod  g^x) 


(B-l) 


However  from  the  construction  of  g  (x)  as  given  in  equation 
(13),  (T-t)  of  the  Y^(x)  coefficients  are  zero. 

Y^(x)  =  0  mod  g.(x)  i  =  t+1,  t+2,  ...,  T  ( B—  2) 

Thus  g(x)  is  in  a  smaller  subspace  of  Ar;  it  is  defined  by  the 
first  t  minimal  ideals. 


g  (x)  e  ©  M. 

i=l  1 


Since  the  finite  direct  sum  of  ideals  is  an  ideal,  it  follows 


that 


(jg(x)))  C  ,®L  Mi 


On  the  other  hand,  the  generator  of  each  M^,  e^(x),  i  =  l,  2, 

. . . ,  t,  by  its  respective  definition  (A-16)  is  contained  in  the 
ideal  llg(x)ll  . 


It  then  follows  that 


t 

© 

i=l 


C  (Ml 


so  that  the  desired  identity  (16) 


is  established. 


The  code  G  also  has  an  idempotent  generator  which  will 
be  denoted  by  g^ (x) .  It  satisfies  the  usual  property: 

9 j  tx)  =  g^.  (x)  (B-3) 

Furthermore  it  is  equivalent  to  the  generator  g(x). 

G  =  ((gjfx)]]  =  |[g(x)jj  (b-4) 

The  code  idempotent  acts  as  an  identity  on  the  ideal  G. 

Y  (x)  =  y(x)  gI(x)  ;  All  y(x)  e  G  (B-5) 

These  results  are  proven  below  where  a  method  for  deter¬ 
mining  (xl  is  given.  Unlike  g(x)  its  degree  is  not  neces¬ 
sarily  C.n-k)  . 

One  possible  application  for  the  code  idempotent  in 
representing  the  code  involves  the  cascading  of  filter  sections. 
Say  the  same  code  is  used  in  each  of  several  filter  sections 
which  follow  one  another  in  a  cascade.  Further  suppose  that 
no  decoding  is  performed  until  the  final  section  is  reached. 

If  the  stored  filter  weighting  in  each  of  the  s  sections  is 
given  by  the  codeword  [b^(x)  g  (x) ) ,  i  =  1,  2,  ...,  s,  then 
the  output  would  be  of  the  form 

S  r  i  s 

a(x)  TT  [ b.  (x)  g  (x)|  =  a  (x)  g,(x)  fT  M 
i=lL  1  J  1  i=l  1 


by  repeated  applications  of  property  (B-3). 


;  a(x)  input 
to  cascade 


B-3 


The  idempotent  form  of  the  generator  polynomial  g(x), 
labeled  by  g^  (x) ,  may  be  constructed  by  noting  that  g (x) 
and  h(x)  are  relatively  prime.  (They  share  no  common 
irreducible  factors.)  Thus  there  are  polynomials  d  (x)  and 
f  (x)  for  which  it  is  possible  to  write: 

d(x)  g(x)  +  f(x)  h(x)  =  1  (B-6) 

The  idempotent  generator  g.^  (x)  is  the  product  of  d (x)  and  g(x) 

gj  (xl  =  d (x)  g (x)  ( B— 7 ) 

It  is  easy  to  see  that  g^ (x)  and  g(x)  both  generate  the 
same  ideal. 

IK'10))  C  ((g<*>))  on  one  hand  while  g(x)  =  g(x) 

[g.j.(x)  +  f (x)  h(x)]  =  g(x)  g.^  (x)  +  0  on  the  other;  thus  g1 (x) 
divides  g  (x)  and  |{g(x)jj  CT  ((gI  * 

llgi(x))I  =  Kg(x)))  (B_8) 

It  is  possible  using  the  definition  of  g^  (x)  and  the 
basic  equation  (.B-6)  above  to  demonstrate  the  facts  in  equa¬ 
tions  (B-3)  and  (B-5)  .  Their  proofs  parallel  those  associated 
with  the  similar  results  for  minimal  ideal  idempotents  con¬ 
tained  in  Appendix  A. 


Finite  Field  Transform 


The  n  th  root  of  unity,  a,  has  the  following  properties: 

an  =  1  ,  1  for  all  k  <  n 

_  m  (C-l) 

a  e  GF(qm)  ,  n  divides  (q  -  1) 

The  validity  of  the  transform  pair,  equations  (18)  and  (19), 
rests  upon  the  following  identities  concerning  sums  of  roots 
of  unity. 

n-l  n-l 

£  a  =  l  1  =  ( (n)  1  ;  d  =  0  mod  n  (C-2) 

1=0  1=0  P 

( l-ad)  "j;1  adA  =  (l-an)  =  0  ;  d  ?  0  mod  n  (C-3) 

1=0 


The  first  equation  is  a  consequence  of  the  characteristic  of 
the  field  GF (qm)  while  the  second  one  is  the  geometric  sum. 
Since  d  ?  0  mod  n,  (l-ad)  ^  0,  and  equation  (C-3)  implies  that 
the  sum  is  zero 


V1  dl  n 

la  =  0 
1=0 


;  d  0  0  mod  n 


(C-4 ). 


The  relationship  between  equations  (18).  and  (19)  may  be 
examined  by  substituting  one  into  the  other. 


((n-1))D  l  Yi  a-*3  =  ((n  x))  l 

PH  ]  p  j=o 


n-l  ^ 


-l. 


n-l 


h?1  m  j 

*  a 

m=0 


a  5-3  (C- 5) 


However  the  sum  in  brackets  in  the  last  expression  may 


be  evaluated  using  identities  (C-2)  and  (C-4). 


n-1 


£  0j (m-A)  = 

j=0 


((n)) 


;  m  =  5,  mod  n 
;  m  f  i  mod  n 


This  verifies  that  equation  (19)  is  the  inverse  of  equation 

(.18)  and  vice  versa.  The  uniqueness  of  the  transform  follows 

immediately  from  the  linearity  of  the  formulas.  The  inversion 

formula,  equation  (19),  guarantees  that  the  transform  with  all 

zeros  also  has  zero  coefficients  in  the  polynomial  domain  A  . 

n 

The  relationship  between  convolution  and  pointwise  coeffi¬ 
cient  multiplication  in  the  transform  domain,  equation  (20) 
can  be  established  by  considering  the  inversion  of  the  pro¬ 


duct  {a j  y j } . 


-1, 


m 


-1, 


-1, 


n-1 

l 

j=o 

A 

a  .  y  . 

3  3 

-  jm 
a 

n-1 

l 

-  jm 
a  J 

n-1 

l  < 

jk 

a  a J 

o 
i  il 
•n 

o 

i  n 

X 

n-1 

rH 

1 1 
c 

f  n-1 

I 

k=0 

l  a 

SL:  0 

lk 

o 

XI  11 
•r-> 

m=0,  1,  ...,  (n-l)_ 


n-1 


l  y  i  “ 

1=0 


j* 


(C-6) 


j  (k+Jl-m) 


Identities  (C-2)  and  (C-4)  permit  the  evaluation  of  the  sum 

on  j  . 

n-1 

aD lK+x-mj  =  (  '  '  p 

0  otherwise 


l  a3tk+*-m) 
j=0 


( ( n) )  ;  k+fc  =  m  mod  n 

P 


»] 


Appendix  D 

Annihilator  and  Chord  Properties  of 
Transform  Coefficients 


The  Annihilator  Property  relates  the  zeros  of  a  poly¬ 


nomial  c(x)  e  A  with  the  indices  of  the  zero  transform 
n 

✓v 

coefficients  c  ^  .  Using  the  notation  of  the  text  and  in 
particular  the  usual  labeling  of  the  polynomial  and  trans¬ 


form  coefficients/  it  is  possible  to  state  the  following 


Lemma . 


Lemma  Dl 


c (x)  has  a  as  a  root  if  and  only  if  =  0  for  j 
A  where  A  denotes  a  subset  of  the  indices  {0,  1,  .  ..,  (n-1)  }  . 

Proof:  Since  by  definition  c^  =  c(aJ),  the  necessary  part  is 

obvious.  On  the  other  hand  the  inversion  formula  (19)  and  the 

A 

requirement  that  c^  =  0  for  all  j  ^  A  allows  the  following 
form  for  c  (x)  . 


,  .  nr*  /,  -1.  .  I  r  -£m 

c (x)  =  l  ((n  )  )  x  l  c“ 


£  =  0 


meA 


m 


(D-l) 


Evaluating  this  at  a-1,  j  &  A  and  rearranging  the  terms  gives: 

A*  n-1 


(a-3)  =  l  ((n-1)) 


meA 


P  m 


I  a 


i ( j-m) 


(D-2) 


£  =  0 


However  since  j  &  A,  (j-m)  7?  0  mod  n  and  so  identity  (C-4) 
applies  showing  that  the  last  sum  in  (D-2)  is  zero.  Thus 


a  ,  j  f.  A  is  a  root  of  c(x)  where  its  transform  coefficients 
are  zero  for  those  indices  not  in  subset  A. 


The  Chord  Property  describes  a  special  relationship 
among  the  indices  of  equal  transform  coefficients.  The  closure 
property  of  cyclotomic  subsets  resembles  this  useful  property. 


Lemma  D2 

*  * 

c  (x}  e  A  if  and  only  if  (c.)q=c.  ,  j=l ,  2,  ...,  n-1 

J 


Proof:  For  any  c  £  GF(q),  cq  =  c. 


<3  Hf1  <3  jq£  ~  (jq)i 

M  =  '  c „  aJ -1  =  )  c.  a  =  c. 


(c.)q  =  l 


1=0 


1=0 


jq 


;j—  0,  1/  2, 


(D-3) 

(n-1) 


The  coefficients  of  a  polynomial  in  An  are  in  GF (q) .  Then  the 
inversion  formula  (19)  and  the  special  index  property  on  the 
right  of  the  Lemma  lead  to  the  following  development 


(c  )q  =  [  C  (n  11)  ]  V  {c  )q  a  jq* 
x  p  j=0  3 

The  normalizing  factor  ((n  ^) )  is  by 

P 

CGF(q)  . 


;  Jt=0 ,  1,  .  .  .  ,  (n-1) 

definition  in  GF(p) 


(D- 


(c ^  1 q  =  C(n  1 

Since  (n,ql  =  1,  a  change 
mation  is  possible  and  an 
on  the  right  of  (D-5) . 


n-1 


l 

j=Q 


a 


-jqit 


of  variables  m  =  jq  in 
equivalent  expression 


the 
for  c 


(D-5) 


sum- 


emerges 


Appendix  E 


Error  Correction  in  the  Transform  Domain 


Suppose  that  the  desired  output  from  the  componentwise 
multiplications  in  the  transform  domain  for  component  i/  i  =  1» 

A 

2,  t  is  denoted  genetically  by  {c^}.  Let  c^(x)  desig¬ 

nate  the  corresponding  polynomial  obtained  from  the  inversion 
process . 


c  .  .  =  a  .  .  Y  .  . 
ID  ID  ID 


■ci  tx)  7  i  1;  2 ,  .  •  •  /  t 


j  e  A v  1 
J  s 

Errors  can  be  introduced  in  several  operations.  When  the 

A 

stored  transform  coefficients  {y.^}  are  delivered  to  the 

A 

multiplier  system,  they  could  contain  errors  {o^j}  ;  the 
input  coefficients  {a^.}  could  contain  errors  modeled  by  the 

✓v 

terms  } • 


(Yij  + 


Erroneous  Stored  Sequence 


uij  +  "ij’ 


Erroneous  Input  Sequence 


Label  the  final  result  of  the  pointwise  coefficient  multipli- 

A 

cations  by  {d^}.  The  most  general  form  of  these  coefficients 
including  all  types  of  errors  is  given  by: 


dij  =  (lfij  +  °ij>  (“ij  +  ,1ij)  +  vij 


Thus  it  is  possible  to  include  all  of  these  types  of  errors  in 

A 

the  following  expression  where  the  noise  coefficients  .  are 

A 

added  to  the  desired  coefficients  c. . 

iD 


d.  .  =  c . .  +  e  .  . 
ID  ID  ID 


;  e .  .  Noise  Terms 
ID 


l  1  f  2 ,  •  •  •  f  t 


(E-l) 


j  e  A 


where 


c .  .  =  a .  .  v  .  . 
iD  i]  i] 


;  a^j  Input  Terms 


y.  .  Stored  Terms 
ID 


(E-2) 


The  coefficients  of  d^x)  are  related  to  the  d„  through 


the  inverse  transform: 


d .  0  =  (.  ( n  ))  T  , . ,  d .  .  a 
lit  P  .!  “  a  (i) 


i  =  1,  2, 


t 


j  e  A, 


(E-3) 


S,  =  0,  1,  .  .  .  ,  (n-1) 


where 


n-i 

d  (x)  =  l  d  x 
1  £=0 


(E-4 ) 


The  inversion  process  satisfies  the  Annihilator  Property, 
Lemma  Dl,  Appendix  D.  (This  guarantees  that  d^(x)  e  pro¬ 
vided  d .  (x)  e  A  )  . 


E  -3.  ' 


It  will  be  assumed  that  the  size  of  the  cyclotomic  subset 
Ag  t  denoted  by  is  greater  than  one  throughout  the  remain¬ 

der  of  the  appendix.  The  ramifications  of  this  assumption  will 
become  apparent  as  the  development  progresses.  The  transform 

A 

domain  errors,  are  reflected  to  the  polynomial  components 

as  an  error  polynomial  e^(x)  by  the  inversion  formula. 

di(xl  =  c^x)  +  ei(x)  ;  e .  (x)  Error 

Polynomial 

c.  Cx)  Desired  (E-5) 

Result 

i  =  1,  2,  .  .  . ,  t 

/v 

If  the  error  coefficients  do  not  satisfy  the  Chord  Property, 

Lemma  D2  indicates  that  not  all  coefficients  of  e^(x)  are  in 
GF  (.q)  ,  an  easily  detectable  condition. 

There  are  simple  sufficient  conditions  for  violating  the 
Chord  Property. 

Lemma  El 


If  at  least  one  transform  coefficient  is  zero  while  others 
are  nonzero  then  these  coefficients  do  not  satisfy  the  Chord 
Property . 


Proof : 


Let  e . . 

^3, 


=  0  while  e . 

im. 


f  0  for 


Then 


by  the  construction  of  the  cyclotomic  subset  A^,  there  is  a 

s 

r* 

Tq  such  that  =  m ®  mod  n.  Assume  that  the  Chord  Property 


holds.  Then  it  follows  that 


E-4- 


n  r  A 

(e.  )q  =e._0  =  e..  =  0 


imQq 


But  this  is  a  contradiction  of  the  fact  that 


(e,m  ^  0 

im0 

This  Lemma  insures  that  the  Chord  Property  is  the  basis 
for  detecting  up  to  (8.^  -  1)  errors  in  the  noise  coefficients. 
Thus  the  size  of  the  cyclotomic  subset  takes  on  the  same  impor¬ 
tance  as  minimum  distance  does  in  normal  bounded  distance 
decoding  [3-5].  The  analogy  does  not  stop  there.  The  error- 
correcting  performance  in  the  transform  domain  which  will  be 
developed  next  extends  up  to  (8^  -  l)/2  errors  in  the  coeffi¬ 
cients  . 

For  error-correcting  purposes  the  transform  coefficients 

A 

d^j  which  are  the  inputs  to  the  inversion  formula  (E-3)  will 
be  called  the  Master  Sequence.  If  all  of  its  items  are  correct, 
each  coefficient  could  be  used,  by  invoking  the  Chord  Property, 
to  generate  8^  different  Test  Sequences  by  repeatedly  forming 
the  q—  power  of  each  successive  element.  This  concept  of  a 
Master  Sequence  and  8^  Test  Sequences  is  shown  in  Figure  E-l 
where  each  element  in  a  Test  Sequence  is  listed  directly  under 
its  correspondingly  indexed  term  in  the  Master  Sequence.  The 
generating  coefficient  in  each  Test  Sequence  is  surrounded  by  a 


box . 


Suppose  now  that  some  of  the  coefficients  in  the  Master 
Sequence  have  nonzero  error  coefficients.  Say  there  are  v 
where  the  integer  v  is  less  or  equal  to  (JU  -  l)/2. 

A  A  A 

{£..  ,  ,  ....  e..  }  =  NONZERO  NOISE  COEFFICIENTS 

1]1  ^2 

£i  -  1  (E-5) 


Further  assume,  only  momentarily  though,  that  the  formation  of 
the  2.^  Test  Sequence  is  error-free.  Most  test  sequences,  except 

/\  A  A 

those  generated  by  d . .  ,  d..  ,  .  ..,  d..  which  do  not  obey  the 

1]1  l32 

Chord  Property,  will  have  more  than  Si.  correct  terms  in  common 

"T 

with  the  Master  Sequence.  The  remaining  Test  Sequences  represent 

questionable  positions  in  the  Master  Sequence.  However  the 

incorrect  positions  can  be  determined  using  the  Chord  Property 

and  the  known  correct  positions.  Alternately  a  majority  decision 

on  a  particular  position  using  all  the  Test  Sequences  and  the 

Master  Sequence  gives  the  correct  value  for  that  position. 

Now  remove  the  requirement,  introduced  directly  above,  that 

the  generation  of  the  Test  Sequences  be  error-free.  Say  a 

position  in  the  Master  Sequence  is  correct  but  that  the  Test 

Sequence  generated  from  it  contains  errors  due  to  the  generation 

process.  It  is  easy  to  see  that  as  long  as  the  additional  number 

of  erroneous  Test  Sequences  combined  with  the  number  of  original 

errors  does  not  exceed  2,^-1,  then  the  correction  technique  using 

2 

a  majority  decision  will  not  affect  the  correct  positions. 


Appendix  F 


Fast  Finite  Field  Transform  Algorithm: 

Development,  Properties  and  Error  Propagation 

Prime  factor  fast  finite  field  forward  and  inverse 
transform  algorithms  are  developed  in  this  appendix.  The 
intermediate  variables  used  in  each  of  the  algorithms 
possess  useful  properties  concerning  chord  lengths.  Such 
properties  can  be  employed  for  distributed  error  control 
in  system  realizations.  The  propagation  and  penetration 
of  internal  errors  are  investigated,  and,  in  the  case  of 
the  inverse  transform,  the  output  error  polynomials  due  to 
single  errors  within  the  structure  are  explicitly  deter¬ 
mined. 

The  forward  transform  will  be  considered  first  where 
both  decimation  in  frequency  and  decimation  in  time  forms 
of  fast  algorithms  are  developed.  Some  parts  of  typical 
signal  flow  charts  are  shown.  Analogous  developments 
for  the  inverse  transform  are  presented  in  the  latter  half 
of  the  appendix. 

The  decimation  in  frequency  form  of  the  forward  trans¬ 
form  stems  from  the  following  decomposition  of  the  i  and 
j  indices  in  equation  (32). 


The  prime  p^  is  a  factor  in  equation  (33)  while 


n2  "  £  ^ 


(F-2) 


Intermediate  variables  Z.  .  is  defined. 

31,X2 


j-i  i2  pl-1 

Z .  .  =  a  T  a . 

j 1 / ^2  i  _q  1in2+^2 


,  n2» 11^1 
( ot  ) 


The  transform  coefficient,  a  ^  ,  may  be  expressed  as: 


n2“l 


„  l 


P1X232  • 


i  +  i  d  =  Zi  i  (ct  >  ;  3=3i  +  3 2P1 

31  +  32pl  j  _=0  31,x2  1  21 


The  development  continues  in  this  fashion  refining  any  index 
whose  range  limits  contain  composite  numbers.  Table  F-la 
summarizes  the  straightforward  development  of  a  fast  trans¬ 
form  when  n  contains  four  prime  factors. 

The  decimation  in  time  approach  may  be  developed 
starting  with  the  expansion  of  indices  as: 

i  —  i^  +  ^2^2  7  ^i  *  =  0,1,...  (p1-l) 

(F-3) 

j  j  Yn2  ^  3  2  '  X2  ’  3 2  ~~  ^  ^ '  ■  ’  ’  ^ 

Thus  the  desired  output  variable,  say  ,  may  be  written 

in  terms  of  intermediate  variables,  Y. 

32'  11 
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INTERMEDIATE  VARIABLES  IN  A  FAST  FORWARD  TRANSFORM 


1  ± 


;  0<j2<n2,  (F-4 ) 


a3ln2 


+  j. 


(ot  z) 


*■1=0 


°li1<P1 

The  next  step  is  to  define  other  intermediate  variables 
by  further  decomposing  indices  which  range  up  to  n2  using 
the  prime  p2  and 

M 


Table  F-lb  shows  the  interrelationship  between  intermediate 

variables  for  a  four  factor  value  of  n.  The  input  data  with 

indices  expressed  in  a  mixed  radix  notation  are  used  to 

define  intermediate  variables  Y .  which  in  turn  are 

-I4,13,:l2,11 

to  define  the  Y.  .  .  -etc.  See  Figure  8b  in  the  text 

^  3' 12' X1 ' 

for  the  general  flow  of  the  defining  relationships. 

The  intermediate  variables  obey  the  interesting 
properties  typified  by  equations  (34)  and  (35).  They  equate 
the  q—  power  of  variables  with  other  variables  having 
specially  related  indices.  Such  properties  might  accurately 
be  called  limited  chord  properties  since  the  related  indices 
are  reduced  modulo  divisors  of  n.  They  are  based  upon  the 
input  data  lying  in  the  field  GF (q) .  These  properties  allow 
distributed  error  protection  within  the  algorithm. 

A  proof  of  one  of  the  properties  will  be  outlined; 
similar  proofs  are  easily  constructed  for  all  of  them  possibly 

involving  finite  induction.  Take  for  example,  Z.  .  ,  and 

th  12 

consider  its  q —  power. 


The  index  (j^q)  is  reduced  modulo  p^  because  of  the  range 
of  the  variable. 

Parts  of  the  signal  flow  graph  for  the  first  stage  of 
the  fast  forward  algorithm  are  shown  in  Figure  F-l.  Note 
that  an  error  in  one  input  datum  can  propagate  to  either 
p^  or  p^  new  intermediate  variables  depending  on  the  form. 
However,  because  of  the  limited  chord  properties,  it  is 
possible  to  perform  detection  and  correction  as  outlined 
earlier  using  q—  powers  of  the  variables.  There  is  one 
possible  difficulty,  though.  The  chord  length  must  exceed 
cne  so  as  to  offer  any  error  control  capability. 

There  are  constraints  that  guarantee  that  all  chord 
lengths,  involving  non-zero  indices,  exceed  a  known  integer. 
This  general  result  will  be  stated  in  the  nature  of  a  theorem. 
Theorem  If  (n,  (q1-!)  )  =  1  for  all  i<  £,  there  are 

no  integers  j  and  s,  0<j<t,  s<£  such  that 

jqS=  j  mod  t  ( F-6 ) 

where  t|n 

Proof:  Since  t|n,  (t,  (qX- 1 )  )=  1,  0<ii£  also. 


r.V 

i  j 

!*•  , 


Each  input  datum  enters  into  the  formation  of  inter 
mediate  variables  for  each  i2  =0,  1,  (n2~l). 

DECIMATION  IN  FREQUENCY  FORM 
FIGURE  F-la 

PART  OF  FIRST  STAGE,  FAST  FORWARD  ALGORITHM 


FIGURE  F-l 


Suppose  that  j0  and  s0  exist  which  satisfy  the  equation. 

Then  t|jc(q  -1).  But  since  (t,  (q  -1)  )=1  it  follows 

that  1 1 j  0  which  is  impossible  because  of  the  range  of  j. 

$ 

Thus  by  constraining  the  length  n  so  that  it  shares 
no  prime  factors  with 

(qi-l )  ; i<£  (F-7) 

all  intermediate  variables  with  non-zero  indices  will  be 
part  of  chords  with  lengths  exceeding  X,.  The  error  detection 
and  correction  procedures  have  been  outlined  earlier.  Note, 
though,  that  in  equation  (32),  nj(qm-l)  and  so  £  must  be 
less  than  m. 

The  intermediate  variables  with  zero  indices  are  in  the 
field  GF(q)  giving  chord  lengths  of  one.  Thus,  no  error 
protection  through  chord  lengths  can  be  applied.  Nevertheless, 
at  the  next  stage,  each  such  variable  has  a  direct  impact  on 
newly  defined  intermediate  variables  which  are  part  of  error- 
protected  chords.  The  next  stage  in  the  algorithms  will  be 
discussed  so  that  this  will  be  apparent. 

Figure  F-2  displays  parts  of  the  second  state  of  each 
form  of  the  algorithm.  It  is  an  easy  matter  to  demonstrate 
the  properties  in  equations  (34)  and  (35)  for  the  new 
intermediate  variables  appearing  at  the  conclusion  of  this 
stage.  For  example,  in  the  case  of  the  decimation  in  frequency 
form,  the  limited  chord  property  applies  to  the  two  indices. 


j1  and  j_,  of  Z.  .  .  .  In  this  situation,  each  index 

1  ->1'  32'  3 

may  have  different  chord  lengths,  a  case  to  be  considered 
next. 

Suppose  two  non-zero  indices,  and  j 2  have  respective 
limited  chord  lengths  £^  and  £2  established  by  the  following 
requirements 

^1 

j^q  =j^  mod  p^  ;  £^  least 

«  (F-8 

j2q  =j2  mod  p2  ;  £2  least 

The  overall  chord  length  of  Z .  .  .  describing  the 

Jl'  3 2'  13 

behavior  when  taking  repeated  qth  powers,  is  easily  seen  to 
be  the  least  common  multiple  of  £^  and  £2> 

Li2~  L-  c-  M.  ;£2)»  Overall  Chord  Length  (F-9 

This  same  principe  can  be  generalized  to  intermediate 
variables  involving  more  than  two  indices  in  their  limited 
chord  properties. 

If  a  constraint  similar  to  indentity  (F-7)  is  imposed 
on  the  transform  length  n,  all  chord  lengths  at  the  second 
stage  will  permit  error  protection  except  for  the  case  when 
j  ^=0= j  j  *  However,  in  such  a  case  the  defining  equation  for 

Z.  .  .  ,  Table  F-la,  shows  that  any  errors  in 

3l,:i2f  33,14 

Z n  n  •  /  i,  fixed,  prooogate  to  terms  like  Z  .  .  , 

0,0, 3  ‘  0 '  0 ' D3' x4 

0<j3<p3  which  appear  in  nontrival  chords.  Furthermore  there 
could  be  numerous  chords  at  this  level  allowing  the  source 


to  be  identified. 


0  >  0 /  ^2 

The  general  development  and  error  protection  available  in 
the  fast  tranforms  are  now  clear.  The  fast  inverse  trnasform 
will  be  considered  next. 

The  inverse  transform  is  given  by 


n-1  ~  ■ 

a.  =  ((n  X)  )  l  a.  (ot)  3  ;  (  (x)  )  =  x  mod  p  (F-10) 

3  p  j  =  0  3  P 


where  the  letters  a  are  used  for  convenience.  In  the  context 
of  signal  processing  the  inverse  transform  would  be  applied 

A 

to  the  A.  transform  coefficients  to  yield  the  coefficients 
3 

in  6 (x)  (see  Figure  6).  The  chord  property,  equation  (30), 
generically  stated  as, 


(a . ) q  =  a .  ;  jq  mod  n 

3  3<3 


(F- 11) 


imposes  constraints  on  intermediate  variables  within  a  fast 
algorithm.  Such  algorithms  have  two  forms  and  may  be  devel¬ 
oped  as  before.  Table  F-2  gives  the  definitions  for  a  four 
factor  version. 

A  proof  of  the  limited  chord  properties  listed  in  equations 
(41)  and  (42)  relies  upon  the  condition  (n,q)  =  1.  For  example 
to  show  that 


1'  J  2 '  J3 


37/ 


^lq'  ^  2q '  3  3q ' 


;  j  xq  mod  p^  j2q  mod  p2, 
j3q  mod  p3 


(F-12) 


INTERMEDIATE  VARIABLE  DEFINITION 


the  defining  equation  from  Table  F-2a  is  used. 


(z\  .  .  ,q  Pi  P2  "r1 

Dir  D2'  ^>3'  14>  =  “  L 

J  j4=0 


(F-13) 


i4Cq:i4)pl  p2  p3  - 


qjx  +  qj2pl  +  q:i3PlP2  +  (qj4)plP2P3 


However  (q,n)  =  1  implies  (q,n4)  =  1  because  n^jn. 

So  ( (q  1))n  =  q  ^  mod  n^  exists  and  the  change  of  variables 

“4 

5  -  <<«3>>n  34 

4 


is  one  to  one  mod  n,  since  j.  =  ( (q  ))  5  is  the  inverse 

4  4  n . 

4 

mapping. 

-  a  3 3q  i4PlP2  P^_1  Pi PoPo  i4? 

(Z.  .  .  .  )q  =  a  3  4  2  y  (a  1  2  3)  4 

3 3 2*  D3/  ^ _ q 


(F-14) 


q3l  +  q32Pl  +  q^3PlP2  +  ^Plp2P3  Zqjlf  qj2»  qj3>  i4 
A  proof  of  (Y .  .  )q  =  Y  .  .  uses  the  same  reasoning  and 

32'  12  q3  2'  1 2 

similarly  for  the  remaining  properties  in  equations  (41)  and 
(42)  . 

The  limited  chord  properties  can  be  used  for  error  control 
in  the  inverse  transform  algorithm  just  as  before,  and  the 
sufficient  conditions  (F-7)  guarantee  a  minimum  length  for  all 
Lhe  chords  involving  nonzero  indices.  However  errors  in  terms 
with  zero  indices  can  be  a  source  of  difficulty  because  they 
are  elements  in  GF(q).  .  The  fast  inverse  transform  algorithm 


systematically  produces  some  intermediate  values  in  GF (q)  at 
each  stage  and  uses  them  in  the  formation  of  new  intermediate 
values  which  are  also  in  GF(q)  at  the  next  stage.  Therefore 
in  some  instances  there  is  no  useful  chord  property  available 
for  error  control.  On  the  other  hand  though  the  error-correct 
ing  code  over  the  final  n  output  values  can  handle  these  pro¬ 
pagating  errors. 

Typical  parts  of  the  last  two  stages  of  the  decimation 
in  frequency  form  are  shown  in  Figure  F-3,  When  an  error,  e, 

/s 

occurs  in  intermediate  variable  Z^,  ^  ,  at  the  input  to  the 
last  stage  errors  appear  in  p^  terms 


+  e 


A1 


0,  1, 


•  •  •  t  t 1 )  • 


The  error  components  in  the  output  are  additive  and  can  be 
expressed  as  an  error  polynomial. 


e  (x) 


I 


i=0 


i 


n  i 

x  -1 


(F-15) 


If  this  single  additive  error,  e,  occurred  in  the  next  to 

A 

last  stage,  say  in  term  Z_  n  .  ,  the  same  additive  error 

v /  U  9 

value  e  will  appear  in  the  (p^P2^  output  values 


a.  .  .  +  e  ;  i.— 0,  1,  ...,  (p^— 1) 

xln2  +  x2n3  +  x3  1  1 

1 2~ ^ ^  »  • ■ • ,  (P2~l) 


The  error  polynomial  corresponding  with  these  (p,p2)  errors  is 


I 


i-,  P1  ^  P2  ^  i„n„  i,n 


e (x)  =  e  x  J  l  l  (x  2  3)  (x  1  2) 


ix=o  i2=o 


=  e  x 


n  i 

x  -1 


;'n3  . 

x  -1 


^3  =  Plf>2 


( F  —  1 6 ) 


For  the  decimation  in  frequency  form,  the  output  errors 
resulting  from  internal  errors  in  various  stages  is  summarized 
in  Table  1  of  the  text 

The  propagation  of  errors  in  the  decimation  in  time  form 
behaves  in  an  analogous  manner.  The  last  two  stages  are 
exemplified  by  the  parts  in  Figure  F-4  from  which  error 
penetration  effects  may  be  studied.  Carefully  analyzing 
terms  with  first  index  set  to  zero  shows  how  internal  errors  in 
GF(q)  terms  pass  through  to  the  output.  The  error  polynomials 
associated  with  such  error  are  also  given  in  Table  1. 

The  error  polynomials  for  either  form  represent  very 
special  types  of  error  patterns,  one  with  identical  errors  in 
well-defined  locations.  The  few  errors  that  can  propagate 
to  the  output  can  be  detected  and  corrected  by  the  overall 
cyclic  codes  if  its  generator  polynomial,  g(x),  is  properly 
chosen.  It  must  not  divide  any  of  the  possible  error  poly¬ 
nomials.  Since  the  inverse  algorithm  is  additive,  all 
possible  output  errors,  caused  by  internal  failure  pro¬ 
ducing  GF(q)  errors  in  vulnerable  intermediate  variables,  can 
be  constructed  by  linear  combinations  of  the  error  polynomials 
already  given. 
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PART  OF  LAST  STAGE 
FIGURE  F-4a 


PART  OF  DECIMATION  IN  TIME  FORM,  FAST  INVERSE  TRANSFORM 

FIGURE  F-4 


On4+j4,i2,i1 


PART  OF  NEXT  TO  LAST  STAGE 


FIGURE  F-4b 


